Trajectory formation of articulatory movements for a given sequence of phonemes
نویسندگان
چکیده
The method proposed here produces trajectories of articulatory movements based on a kinematic triphone model and the mimimum-jerk model. The kinematic triphone model, which is constructed from articulatory data obtained in the experiments through the use of a magnetic sensor system, is characterized by three kinematic features for a triphone and intervals between two successive phonemes in the triphone. After extracting a kinematic feature for a phoneme in a given sentence, for each point on the articulator, the minimum-jerk trajectory which coincides with the extremum of the time integral of the square of the magnitude of jerk of the point is formulated, which requires only linear computation. The method predicts both the qualitative features and the quantitative details experimentally observed.
منابع مشابه
Acoustic-to-articulatory inversion using speech recognition and trajectory formation based on phoneme hidden Markov models
In order to recover the movements of usually hidden articulators such as tongue or velum, we have developed a data-based speech inversion method. HMMs are trained, in a multistream framework, from two synchronous streams: articulatory movements measured by EMA, and MFCC + energy from the speech signal. A speech recognition procedure based on the acoustic part of the HMMs delivers the chain of p...
متن کاملPrediction of the Articulatory Movements of Unseen Phonemes of a Speaker Using the Speech Structure of Another Speaker
In this paper, we propose a method to predict the articulatory movements of phonemes that are difficult for a speaker to pronounce correctly because those phonemes are not seen in the native language of that speaker. When one wants to predict the articulatory movements of those unseen phonemes, since he/she has difficulty to generate those sounds, the conventional acoustic-to-articulatory mappi...
متن کاملA trajectory formation model of articulatory movements using a multidimensional phonemic task
This paper presents a model for representing context-dependent variation of articulator movements. Our model explains the contextual e ect based on a multidimensional phonemic task and dynamic constraints of movements. The task determines the articulatory target so that invariant features of phoneme articulation are achieved. The dynamic constraints represent smoothly moving behavior of the art...
متن کاملSignal approximation in Hilbert space and its application on articulatory speech synthesis
In this paper, we apply signal approximation theory to estimate the articulatory trajectory for a nonlinear speech synthesizer. First, we analyze the L2 error bounds of interpolation and LS approximation in the Hilbert space framework. Second, we use two signal approximation techniques, speci cally, cubic spline interpolation and the LS approximation to estimate the trajectory of articulatory p...
متن کاملAcoustic-to-articulatory inversion in speech based on statistical models
Two speech inversion methods are implemented and compared. In the first, multistream Hidden Markov Models (HMMs) of phonemes are jointly trained from synchronous streams of articulatory data acquired by EMA and speech spectral parameters; an acoustic recognition system uses the acoustic part of the HMMs to deliver a phoneme chain and the states durations; this information is then used by a traj...
متن کامل